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Introduction.  In  previous  works,  relations  between  dyadic 
and  Kronecker  products  of  vectors  (definitions  follow)  are 
explored,  cf.  [2],  [31.  In  fact,  consider  the  general  situation 
where  finite  rank  linear  transformation  R on  Infinite-dimensional 
Hilbert  space,  H,  Is  the  sum  of  dyadic  products.  If  the  nuniber 
of  terms  of  this  sum  Is  known,  then  these  dyadic  terms  can  be 
fairly  well  characterized  [3,  Thm.  3.2].  In  this  paper,  we 
consider  dyadic  sum  decompositions  for  R where  N,  the  number  of 
terms.  Is  not  known  a priori . and  present  a sharp  Inequality 
which  ties  together 

(I)  the  rank  of  R, 

(II)  the  ranks  (dimension  of  the  spans)  of  the  dyad  component 
vectors,  and 

(III)  N,  the  number  of  distinct  dyads  which  sum  to  R. 

This  Inequality  proves  useful  for  establishing  necessary  condi- 
tions for  certain  special  questions,  e.g.,  when  do  N dyads  sum 
to  a single  Kronecker  product,  or  when  do  N dyads  sum  to 
(another)  dyad?  These  questions.  In  turn,  relate  to  the  com- 
plexity question  In  the  computation  of  matrix  products,  cf., 

[4],  [1]. 

2.  Definitions  and  Preliminaries.  L(H,K)  denotes  all  bounded 
linear  transformations  from  Hilbert  space  H to  Hilbert  space  K. 

AsKmt  the  elements  of  L(H,K)  are  the  dvads  (rank  one  transforma- 
tions) (x  X y)  defined  for  each  y ^ H,  x € K by  requiring  that 
for  all  z € H,  (x  X y);z  -*  (z,y)x,  where  ( , > Is  the  Inner 
product  on  H.  We  proceed  to  give  the  Kronecker  or  tensor  product  T 


3 


► 

Then  for  N-n  arbitrary  vectors  H we  have 

the  representation 

N 

(u^  X Vj^)  - R (2.1) 

If  and  only  If  each  "earlier"  v^^  Is  given  by 

N 

- K*i\)  - ^ ^ (2.2) 

j-n+1 

where  ^ span  <U>  Is  the  unique  blorthonormal 

complement  to  (uj^,U2» . . . ,u^)  In  span  <U>  (l.e.,  <(l^,Uj>  - 6^^^, 
the  Kronecker  delta).  The  summation  In  (2.2)  Is  taken  to  be 
zero  In  case  n * N. 

3.  The  Inequality 

Theorem  3.1.  Given  finite-rank  linear  transformation  R € L(H,K) 
and  sets  of  vectors  U - (uj^»U2, . .. . ,u^)  c r,  V - {v^,V2, . . . ,Vjj)  ch 
such  that 

N 

(«1  X Vj^)  - R . (3.1) 

1-1 

Then 


2*rk(R)  a r(U)  + r(V)  a rk(R)  + N , 


i 


(3.2) 


«3C” 


where  rk(R)  <■  dimension  (range  of  R) , and 
r(U)  " dimension  (span  <U>) 
r(V)  ■ dimension  (span  <V>). 
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Proof;  By  re-ordering  the  terms  of  sum  (3.1)  if  necessary,  we 
will  assume  that  the  first  n ■ r(U)  elements,  Uj^,U2, . . . ,u^  of 
U,  form  a basis  for  span  <U>.  Thus,  the  ordered  set  V lends 
itself  to  characterization  (2.2).  in  fact, 

r(V)  - rank(span<Vj^,V2,...,Vj^,v^^^,...,Vjj>)  , (3.3) 

N 

where  ■ R*(flj^)  - , i - l,2,...n  (from  (2.2)). 

J-n-fl 

Equivalently, 

r(V)  - rank(span(R*({li)  ,R*((i2) »''n+l*  ’ * * 

The  equivalence  of  (3.3)  and  (3.4)  follows  by  observing  that 
each  of  the  N vectors  in  (3.4)  belongs  to  the  linear  span  of 
the  M vectors  in  (3.3),  and  vice  versa.  From  (3.4)  we  now 
obtain 

r(V)  ^ rank(span<R*((i]^) , . . . ,R*((J^)  >)+rank(span(v^^2^ Vj^>) 

rk(R*)  + N - n (3.5) 

- rk(R)  + N - r(U)  , 
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which  gives  us  the  right-hand  side  o£  Inequality  (3.2).  Obtain- 
ing the  left-hand  side  of  (3.2)  Is  Immediate , since  from  (3.1) 
we  deduce  that  span  <U>  =>  range  R,  while  span  <V>  =>  range  R* 
(recall  (Uj^  x v^)*  - (v^  x u^^)).  Thus,  r(U)  ^ rk(R)  and 
r(V)  i rk(R*)  - rk(R)  lnq> lying 

2*rk(R)  i r(U)  + r(V).  (3.6) 

Finally,  (3.5)  with  (3.6)  establishes  (3.2)  and  the  proof  Is 
done.  ■ 

Hi  QiS.  gharp?  The  left  side  of  (3.2)  yields 

equality  whenever  the  entire  N-element  sets  U and  V are  linearly 
Independent  (l.e.,  when  n • R ■ rk(R)).  In  following  the  proof 

' of  the  right-hand  Inequality  for  (3.2),  we  observe  the  two 

i ' 

Inequalities  In  (3.5).  The  first  Inequality  yields  equality  If 
and  only  If 

span(R*((i^)  ,R*(&2) ^^®P*"^''n+l»''n+2»  • * * 

That  Is,  by  choosing  each  of  the  N-n  arbitrary  vectors  . . . .v^ 

In  H outside  the  range  of  R*.  The  second  Inequality  of  (3.5) 
becomes  equality  If  and  only  If  the  H-n  element  set 
1*0+1  »hJ  Is  linearly  Independent. 

4.  Final  Resaarks.  In  [3,  Th.  4.2,  4.3],  It  Is  shown  that 
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X ■ R If  and  only  if  ^ ® v^)  - R*  (4.1) 

where  Che  passage  from  R Co  K'  Is  a well-defined  linear  relaClon- 
shlp.  This  provides  a dual  form  Co  (3.2)  wlch  Censor  produces 
replacing  Che  dyads  of  (3.1)  and  Chls  R*  replacing  R.  As  an 
easy  special  case,  lec  us  use  (3.2)  and  dyad-Censor  duallcy  Co 
JusClfy  Che  following  scacemencs  for  non-zero  u^,  y^  € H, 

1 - 1,  2,  3. 

Proposlclon.  Suppose 

(ui  X Vj^)  + (U2  X V2)  - (U3  X V3)  , and  (4.2a) 

(*1  ® “i)  + (*2  ® " (*3  ® y^^  • (4.2b) 

Then  all  Che  u^^'s  or  else  all  Che  v^'s  are  non-zero  scalar 
mulclples  of  each  ocher.  Similarly,  all  che  x^'s  or  else  all 
Che  y^'s  scalar  mulclples  of  each  ocher. 

Proof.  The  proof  of  chls  asserclon  will  noc  appeal  co  che 
deflnlclons  of  Che  dyad  (u^  x v^^)  or  of  che  Censor  (x^  ® y^) , 
since  InequallCy  (3.2)  applies.  In  face,  wrlce  (4.2a)  as 

(Uj^  X Vj^)  + (U2  X V2)  - (U3  X V3)  - 0 (i.e.,  N ■ 3,  R - 0)  (4.2a') 

from  which  we  obcain  via  (3.2)  chac 


2*0  < r((uj^Al2*'^3)>  + r((v^,V2,V3))  « 0 + 3 


(4.3) 
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Since  we  have  assumed  no  or  is  zero,  the  ranks 

^1.  At  the  same  time,  the  upper  bound  of  3 given 
by  (4,3)  assures  us  that  both  r(u)  - 2 and  r(v)  • 2 can  not 
happen,  l.e.,  at  least  one  of  the  terms  r(u),  r(v)  in  (4.3) 
equals  one,  or  all  the  u^'s  or  all  the  v^^'s  are  scalar 
nultiples  of  each  other.  By  our  duality  result,  (4.1),  (4.2a') 
is  equivalent  to 

(uj^  ® Vj^)  + (U2  ® V2)  - (U3  ® V3)  - 0 , 

and  the  same  conclusion  obtains,  l.e.,  in  (4.2b),  either 
r((x^,X2»X3})  or  r({yj^,y2,y3))  equals  one,  or  all  the  x^^'s  or 
all  the  y^^’s  are  scalar  multiples  of  each  other  if  (4.2b) 
is  given. 


I 


9 


References 

/ 

1.  J.  de  Plllfs,  Schemes  for  fast  matrix  multiplication 
(submitted  to  the  Journal  of  ^he  ACM). 

2.  , Decomposable  tensors  as  sums  of  dyads.  Linear  and 

Multilinear  Algebra  1 (1974),  327-335. 

3.  . Characterizations  of  sums  of  dyads  and  of  Kronecker 
products  (submitted). 

4.  V.  Strassen,  Gaussian  elimination  is  not  optimal,  Numer. 
Math.  13  (1969),  354-356. 


AO-A040  152  AN  INEQUALITY  FOR  SUMS  OF  DYADS  AND  TENSORS(U)  J/ 

CALIFORNIA  UNIV  RIVERSIDE  DEPT  OF  MATHEMATICS  ^ 

d DE  PILLIS  06  MAY  77  AFOSR-TR-77-0670  AF-AFOSR-2585-75 
UNCLASSIFIED  F/G  12/1  NL 

£A/«» 

DTI  C 


MTORMiTlON 

I 

J 


Errata 


AD-AO4O  152 


Page  8 is  blank. 


DTIC-DDAC 
31  Aug  8Ji 


f 


t 


